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(54) Data communication apparatus, data communication system, and data communication 
method 



(57) Cellular phones (1a, 1b) adjust the brightness 
of an image before sending mail with an attached pho- 
tograph, so that it is possible to visually verify the mail 
text when the mail text is overlaid over the image, which 
serves as a background image attached to the mail text 
at the receiving side, after which the mail is send to a 



system (in particular, to mail servers (33) and (63)). The 
color of mail text characters is changed in responsive to 
the image brightness. When the cellular phones (1 a, 1 b) 
receive an e-mail with an attached photograph, they dis- 
play the mail text overlaid over the image as a back- 
ground image (which has had its brightness adjusted). 
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Description 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0001] The present invention relates to a data com- 
munication apparatus, a data communication system, 
and a method for data communication. 

2. Related Art 

[0002] In the past, a system existed for exchanging 
electronic mail (hereinafter referred to also as e-mail or 
mail) having various attached files. In recent years, an 
image capturing function has been added to cellular tel- 
ephones (hereinafter referred to as cell phones) or the 
like to enable a captured image to be attached to an e- 
mail and sent to another wireless communication termi- 
nal. In the case in which an image attached to an e-mail 
is displayed at the receiving-side wireless communica- 
tion terminal, it is usual to display the image independ- 
ently of the mail body text, and there are also systems 
in which the image is displayed at the end of the body 
text of the e-mail. 

[0003] There is also a known service in which a cap- 
tured (photographed) image is uploaded to an ISP (In- 
ternet service provider) with which user registration has 
already been done, notification being given to the other 
party's wireless communication terminal of the URL 
(universal resource locator) of the uploaded image (link 
data for accessing the image uploaded to the IPS serv- 
er). In this case, the URL is displayed along with the mail 
body text at the receiving-side wireless communication 
terminal that receives the e-mail, and when the user of 
the other party's wireless communication terminal spec- 
ifies this URL, the user's wireless communication termi- 
nal is connected to the network and downloads and dis- 
plays the image data from the server (image database). 
[0004] In an image display method related to mail 
service in the past, however, and particularly in the case 
in of a compact wireless communication terminal, be- 
cause of problems such as the size of the display 
screen, it was not possible to display the body text of 
the mail ad the image simultaneously, and when reading 
the text of an e-mail, it was extremely difficult to perform 
simultaneous verification of the image. 
[0005] Accordingly, it is an object of the present inven- 
tion to provide a data communication apparatus, a data 
communication system, and method for data communi- 
cation, which are capable of implementing easy creation 
and sending of mail with simultaneous verification of the 
body text of the mail and the image, and which, even 
when an e-mail is received having an attached image, 
enable easy verification of the original image. 



SUMMARY OF THE INVENTION 

[0006] In order to achieve the above-noted object, a 
first aspect of the present invention is a data communi- 

5 cation apparatus having means for preparing a docu- 
ment to be sent, means for preparing an image to be 
sent, means for setting whether or not the image is to 
be displayed as a background image for the document 
on the display of a receiving-side communication appa- 

10 ratus receiving the document, and means for sending, 
as one set of data, the document, the image and infor- 
mation capable of distinguishing that the image is to be 
displayed as a background image for the document in 
a case in which the setting means sets display as a 

15 background image. 

[0007] A second aspect of the present invention for 
achieving the above-noted object is a data communica- 
tion apparatus capable of receiving data sent by another 
data communication apparatus and having means for 

20 receiving data, display control means for displaying the 
image as a background image for the document in a 
case in which data received by the receiving means in- 
cludes a document, an image and information that can 
distinguish that an instruction is given to display the im- 

25 age as a background image for the document. 

[0008] A third aspect of the present invention for 
achieving the above-noted object is a data communica- 
tion system having a first data communication appara- 
tus and a second data communication apparatus, arid 

30 capable of data communication from the first data com- 
munication apparatus to the second data communica- 
tion apparatus, wherein the first data communication ap- 
paratus comprises means for preparing a document to 
be sent, means for preparing an image to be sent, 

35 means for setting whether or not the image is to be dis- 
played as a background image for the document on the 
display of a receiving-side communication apparatus re- 
ceiving the document and means for sending, as one 
set of data, the document, the image and information 

^0 capable of distinguishing that the image is to be dis- 
played as a background image in a case in which the 
setting means sets display as a background image, and 
wherein the second data communication apparatus 
comprises means for receiving data, display control 

45 means for displaying the image as a background image 
for the document in a case in which data received by the 
receiving means includes a document, an image and in- 
formation that can distinguish that an instruction is given 
to display the image as a background image for the doc- 

50 ument. 

[0009] A fourth aspect of the present invention for 
achieving the above-noted object is a data communica- 
tion method whereby a document and an image are sent 
from a first data communication apparatus to a second 
55 communication apparatus and the image is displayed 
on a display of the second data communication appara- 
tus as a background image for the document, and which 
having a step in the first data communication apparatus 
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of preparing a document to be sent and an image to be 
used as a background image for the document, a step 
in the first data communication apparatus of sending the 
document, the image and information that indicates the 
display of the image as a background image for the doc- 
ument, a step in the second data communication appa- 
ratus of receiving data sent from the first data commu- 
nication apparatus, and a step in the second data com- 
munication apparatus of displaying the image as the 
background image for the document in a case in which 
the received data included the document, the image and 
the indicating information. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] 

Fig. 1 is a block diagram showing the configuration 
of a mail sending/receiving system according to a 
first embodiment of the present invention. 
Fig. 2 shows a cell phone 1a, 1b in the opened con- 
dition, Fig. 2 (a) showing the front of the cell phone 
1a and 1b and Fig. 2 (b) showing the rear of the cell 
phone 1a, 1b. 

Fig. 3 is a block diagram showing the circuit config- 
uration of the cell phone 1a, 1b. 
Fig. 4 is a conceptual representation of the config- 
uration of the memory areas of a ROM 24. 
Fig. 5 is a conceptual representation of the config- 
uration of the memory areas of a RAM 29. 
Fig. 6 is a conceptual representation of the config- 
uration of a mail data storage area 292. 
Fig. 7 through Fig. 9 are collectively a flowchart il- 
lustrating the mail creation processing in the first 
embodiment of the present invention. 
Fig. 10 is a conceptual representation of the image 
brightness, illustrating adjustment of the brightness 
of the image. 

Fig. 11 is a schematic representation of an image 
with the image brightness of the intermediate value 
M a brightness between the intermediate value M 
and the threshold value TH1 (70% brightness) after 
the adjustment of the brightness of the image, and 
an example of a display with the adjusted-bright- 
ness image overlaid by a mail text. 
Fig. 12 is a schematic representation of an image 
with the image brightness of the intermediate value 
M a brightness between the intermediate value M 
and the threshold value TH2 (30% brightness) after 
the adjustment of the brightness of the image, and 
an example of a display with the adjusted-bright- 
ness image overlaid by a mail text. 
Fig. 13 is a flowchart illustrating the received mail 
display processing in the first embodiment of the 
present invention. 

Fig. 14 is a schematic representation showing an 
example of a display of a received list presented on 
the display 13. 



Fig. 1 5 is a conceptual representation of the config- 
uration of the memory areas of the ROM 24 in a 
second embodiment of the present invention. 
Fig. 16 is a conceptual representation illustrating 
5 the overlaying processing of the image with a tem- 
plate file. 

Fig. 17 is a conceptual representation of the config- 
uration of a mail data storage area 292 within the 
RAM 29. 

10 Fig. 18 and Fig. 19 are flowcharts illustrating the 
mail creation processing in the second embodiment 
of the present invention. 

Fig. 20 is a conceptual representation of the config- 
uration of the memory areas of the ROM 24 of a cell 
15 phone in a third embodiment of the present inven- 
tion. 

Fig. 21 is a conceptual representation of the config- 
uration of the memory areas of the F*AM 29 of a cell 
phone in the third embodiment of the present inven- 
20 tion. 

Fig. 22 is a flowchart illustrating the mail creation 
processing in the third embodiment of the present 
invention. 

Fig. 23 is a conceptual representation of another ex- 
25 ample of the configuration of the memory areas of 
the ROM 24 in the third embodiment of the present 
invention. 

Fig. 24 is a flowchart illustrating the mail creation 
processing in a fourth embodiment of the present 
30 invention. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

35 [001 1] Embodiments of the present invention are de- 
scribed below in detail, with references made to relevant 
accompanying drawings. 

[0012] Fig. 1 is a block diagram showing the configu- 
ration of a mail sending/receiving system according to 
^0 the first embodiment of the present invention. In this 
drawing, cell phones (wireless communication termi- 
nals/data communication apparatuses) 1a and 1b have 
photographing apparatuses and image memories capa- 
ble of storing a plurality of images (photographs) photo- 
45 graphed by the photographing apparatuses, in addition 
to a function of sending a mail to which is attached an 
image (photograph) stored in the image memory, and a 
function of receiving a mail to which an image is at- 
tached. The cell phones 1a and 1b also have functions 
50 such as a function of displaying an image attached to 
an e-mail or displaying an embodiment with an image 
attached thereto as a background, and a function of 
sending an e-mail that includes information that in- 
structs a receiving-side terminal (receiving-side cell 
55 phone) to display an attached image as the background 
image of the mail text. Thus, the cell phones 1a and 1b 
not only have the conventional function of being able to 
send and receive images as attached files, but also a 
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mail function that enables the sending and receiving of 
e-mail with having a background image that is the at- 
tached image file displayed as the background. Addi- 
tionally, the cell phones 1a and 1b have a function of 
correcting or adjusting the brightness of the background 
image. 

[001 3] The cell phones 1 a and 1 b, before sending an 
e-mail having a background image, for example, can 
correct the brightness of the image attached to the e- 
mail as a background image, so that when the image is 
displayed as a background image overlaid with the body 
text of the e-mail, the body text is displayed clearly. Stat- 
ed in different terms, when an e-mail having a back- 
ground image is received at the receiving side, with the 
attached file as a background, the body text of the e- 
mail is displayed overlaid on the image. 
[001 4] The wireless base stations 2, via the open pub- 
lic network 4 (more precisely, a cellular phone network 
provided by a communications service provider to the 
users of the cell phones 1a and 1b and having the open 
public network as part of its configuration), make con- 
nection with a center apparatus (including an Internet 
provider) of the communication service provider. 
[0015] The center apparatus (including an Internet 
provider) 3 of the communication service provider has, 
in addition to an exchange, which is necessary for the 
cell phone service provided as a main service, a system 
for connection to WWW5, which is described later (Web 
server 32 and router 35), and a mail system (mail server 
33). The wireless station 2 has a function for connecting 
the cell phones 1a and 1b to the WVWV5 as an access 
point. 

[0016] The open public network 4 includes a cell 
phone network of another communication service pro- 
vider, and analog or digital telephone networks. WWW5 
is the so-called Internet. 

[0017] An Internet service provider (hereinafter ab- 
breviated to ISP) 6, with the exception of the exchange, 
has the same configuration as the center apparatus 3 
of the communication service provider, and has a sys- 
tem for connection to WWW5 (referred to herein as Web 
server 62 and router 65 as a convenience), and a mail 
system (mail server 63). A personal computer 7 makes 
connection to WWW5 via a open public circuit 4 and the 
ISP 6. 

[001 8] In an embodiment of the present invention, the 
cell phones 1a and 1b have a mail function of sending 
and receiving mail having a background image, that is, 
a mail software program for performing display process- 
ing to display an image attached to an e-mail as a back- 
ground image to the body text of the e-mail, an the case 
in which an e-mail having a background image is sent 
and received between the cell phones 1a and 1b, the 
cell phone that receives the e-mail having the back- 
ground image attached thereto displays the image in the 
background, and displays the body text of the associat- 
ed e-mail laid thereover (details described below). In the 
case of a communication apparatus having only the con- 



ventional mail function of the functions of the cell phones 
1a and 1b, for example in the case in which an e-mail 
with a background image is sent to the personal com- 
puter 7, at the personal computer 7 the image attached 

5 to the received e-mail as the background image is treat- 
ed as the usual attached file. Thus, the "mail software 
program for performing processing of an e-mail with a 
background image" has compatibility with a generally 
known mail software program. 

10 [0019] Fig. 2 (a) and Fig. 2 (b) show outer views of the 
cell phones 1 a and 1 b. The cell phones 1 a and 1 b in this 
embodiment of the present invention have a folding con- 
struction formed by a cover part and a main part, Fig. 2 
(a) showing the front view of the cell phones 1a and 1 b 

15 and the Fig. 2 (b) showing the rear view of the cell 
phones 1a and 1b, both in the opened condition. An an- 
tenna 11 is provided at the rear of the cover part and is 
freely extendible and retractable. A speaker 12 is pro- 
vided at the rear surface of the cover part, and provides 

20 audio output. A display (main display) 1 3 is a color LCD 
(liquid-crystal display) having a dot configuration of 120 
dots (width) by 160 dots (height). The main display 13 
is capable of simultaneously displaying the image (pho- 
tograph) an the body text of an e-mail having an image 

25 (background image) 

[0020] A key operation section 14 is formed by such 
parts as a mail key 141, an address key 142, a camera 
key 143, a sub-menu key 144, a cross key (four-direc- 
tion cursor key) 145, a center key (entry key) 146, an 

30 off-hook key 147, an on-hook key 148, and a numerical 
keys 149. The mail key 141 launches a mail function, 
and is used to display a mail menu. The address key 
142 is used to open an address book when selecting the 
mail address of another party or selecting a telephone 

35 number to be called. The camera key 143 launches a 
camera function, and is used to display a camera menu. 
This camera key 143 functions as a display switching 
function, which, when in the mail creation mode or in the 
mail display mode when a mail body text is displayed 

40 overlaid onto a background image, selects display of the 
mail text only or the background image only. The sub- 
menu key 144 is used to display sub-menus for various 
functions. The cross key 145 is used to select a desired 
item from menus displayed for various functions, and for 

45 shifting the inputting position when making data input 
using the numerical keys 149. The center key (entry key) 
146 is used to establish or select menu items selected 
by operation of the cross key 145. The off-hook key 147 
is used to start a call, and the on-hook key 148 is used 

50 to end a call. The numerical keys 149 are used when 
inputting a telephone number or characters. 
[0021] A microphone 1 5 is provided at the bottom part 
of the main part, and is used for voice input. 
[0022] A sub-display 16 is provided at the rear panel 

55 of the cover part. The rear panel key 17 is made of a 
transparent or translucent material, and has a built-in 
LED 171 that lights when a call is received. A photo- 
graphic lens 18 is provided on the rear surface of the 
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cover part 2, below the sub-display 16. A notification 
speaker 1 9 is provided to make notification of a received 
call or the like, and is disposed on the rear surface of 
the main part, so that it is possible to hear a notification 
sound even when the cover is closed onto the main part. 
[0023] Fig. 3 is a block diagram showing the circuit 
configuration of the cell phones 1a and 1b. An RF trans- 
ceiver section 20 sends and receives voice and data 
(mail data) via the antenna 11. The RF signal processor 

21 performs RF signal processing necessary to demod- 
ulate the voice and data (mail data) received by the RF 
transceiver section 20, or modulate voice or data that is 
to be sent to the RF transceiver section 20. A controller 

22 controls various operations and overall operation. 
[0024] An image memory 23 is a memory for storing 
a compressed encrypted file made by a program stored 
in the image processing program area 2413 that proc- 
esses an image obtained by the camera module 181 
and the DSP 182, and image files downloaded via the 
VWVW5. A ROM 24 is configured as a flash ROM, and 
is used to store various programs that are features of 
the present invention. 

[0025] A driver 25 drives the main display 1 3. A driver 

26 drives the sub-display 1 6. A subscriber data memory 

27 stores a telephone number for calling the cell phone 
1, ID and the like of operators (subscribers), and profile 
data. A ROM 28 stored various programs and the like 
that control the controller 18. A RAM 29 stores various 
data required for operation as a wireless communication 
terminal, as well as data required for operation of the 
controller 25 and mail data. 

[0026] An audio signal processor 200 performs en- 
coding of an audio signal input from the microphone 1 5 
and outputting thereof to the RF signal processor 21 , as 
well as decoding of a voice signal from the other party 
input from the RF signal processor 21 and drive of the 
speaker 21 so as to make an audio output. The camera 
module 181 is formed by a CCD or a CMOS device, and 
captures a color image. The DSP 182 performs encod- 
ing of an image captured by the camera module 181. 
The notification driver 192 is a driver for driving the no- 
tification speaker 19, a vibrator 191, and an LED 171. 
[0027] Fig. 4 is a conceptual representation of the 
configuration of the memory areas of the ROM 24. The 
ROM 24 stores software programs that are a feature of 
this embodiment of the present invention. The ROM 24 
is formed by a mail software program area 241, an im- 
age processing program area 2413, and an other pro- 
gram area 2414. 

[0028] The mail software program area 241 is sepa- 
rated into a mail software program area, into which is 
stored a known general mail software program, and a 
background image display handling mail software pro- 
gram area 241 2 having a program that performs display 
processing of an image to be attached to a mail or an 
image attached to a mail as a background image. The 
background image display handling mail software pro- 
gram can be downloaded from WWW5 via the ISP 6. 



[0029] The image processing program area has 
stored in it an image processing program for compres- 
sion processing of a digitally encoded image according 
to the JPEG standard, the PNG standard, or the GIF 

5 standard. In the first embodiment, this image processing 
program distinguishes the average brightness of the 
overall image and performs processing so as to in- 
crease or decrease the brightness. The other program 
area 2414 has stored in it application programs other 

10 than the above. 

[0030] Fig. 5 is a conceptual representation of the 
configuration of the memory areas of the RAM 29. The 
RAM 29 is separated into an address book data storage 
area 291 , a mail data storage area 292, a file attachment 

15 storage area 293, and an other working memory 294. 
The address book data storage area is used to store 
names, telephone numbers, e-mail addresses and the 
like as grouped records. The mail data storage area 292 
stores mail data created by mail software, sent mail da- 

20 ta, and received mail data. The file attachment storage 
area 293 stores file attachments when they are attached 
to files. The other working memory 294 is used as an 
additional working memory to store various data. 
[0031] Fig. 6 is a conceptual representation of the 

25 configuration of the mail data storage area 292. The mail 
data storage area 292 is separated into a working area 
2921 into which is stored mail data currently being 
worked on, an area 2922 that stores a plurality of already 
sent e-mails or e-mails to be sent (send folder), and an 

30 area 2923 that stores a plurality of received mail data. 
The working area 2921 for storing mail data being 
worked on has areas for storing such things as data rep- 
resenting mail destinations (mail address or the like), 
mail subjects, mail body texts, addresses (file attach- 

35 ment addresses) indicating at what address in the file 
attachment storage area 293 or in another file storage 
area a file attachment is stored when a file is attached 
to an e-mail, and identification information (such as a 
mail type identification flag MTF) that indicates whether 

40 an e-mail is a conventional type or a type with a back- 
ground image. The send folder 2922 has areas for stor- 
ing such things as destinations, subjects, mail texts, file 
attachment addresses, mail type flags MTF, date and 
time mail was sent, and identification information indi- 

45 eating whether or not the mail has already been sent 
(mail sent flag MSF). The receive folder 2923 has areas 
for storing such things as data indicating the sending 
(mail addresses and the like), subjects, mail texts, file 
attachment addresses, mail type identification flags 

50 MTF, date and time mail was received, and identification 
information indicating whether or not the mail has al- 
ready been verified as received (mail read flag MRF). 
[0032] The operation of the first embodiment of the 
present invention is described below, taking first the 

55 processing performed to create an e-mail. 

[0033] Fig. 7 through Fig, 9 present a flowchart illus- 
trating the mail creation processing in the first embodi- 
ment. If the mail key 141 is pressed from the waiting 



9 



EP 1 349 407 A2 



10 



condition, the mail mode is launched, and the mail menu 
items "Create New", "Receive Folder", "Send Folder", 
and the like appear on the main display 13. The "Create 
New" item is a menu item selected to create a new e- 
mail, the "Receive Folder" item is a menu item selected 5 
to check received mail, and the "Send Folder" item is a 
menu item selected to check already sent mail and mail 
that has not yet been sent. The flowchart starting in Fig. 
7 starts from the condition in which the mail menu is be- 
ing displayed. 

[0034] First, a judgment is made as to whether or not 
an instruction has been given from the mail menu to cre- 
ate a new e-mail (step S10). In the case in which there 
was no instruction to create a new e-mail, the flow tran- 
sitions to other processing (step S12). If there was an 
instruction to create a new e-mail, however, a menu 
screen for creating an e-mail is displayed (step S14). 
This menu screen is used to select either creation of an 
e-mail using the conventional mail software program or 
creation of an e-mail using the background image dis- 
play handling mail software program. Next, a judgment 
is made as to whether or not selection has been made 
to create e-mail with a background image (step S16). If 
creation of an e-mail with a background image is not se- 
lected, flow proceeds to the conventional e-mail creation 
processing (step S18). 

[0035] If creation of an e-mail with a background im- 
age is selected, however, information indicating mail 
with a background image is set into the mail type flag 
MTF by setting the flag, an the mail creation screen is 
displayed on the display 13 (step S20). From this crea- 
tion screen, items essential to creating an e-mail, these 
being destination, subject and body text and the like, are 
displayed. Net, when each of the items is selected and 
corresponding data is input, the data for each of the in- 
put items is stored into corresponding item areas in the 
working area 2921, and the input data for each of the 
items is displayed on the display 13 (step S22). Next, a 
judgment is made as to whether an enter (verify) oper- 
ation has been made for the input data (step S24). If an 
entry operation had not been made, return is made to 
step S22, and input is continued. 
[0036] If an entry (verification) operation had been 
made, however, a search is made of whether there is 
an image file stored in the image memory 23 that can 
be attached to the e-mail (step S26). A check is also 
made as to whether or not an image file is stored (step 
S28). In the case in which there is no image file stored, 
this is indicated to the user by an error display (step 
S30). This error display is continued until the user 
makes a verifying operation, for example by pressing 
any key, and when a key operation is detected at step 
S32, return is made to step S14. 
[0037] If there was an image file, an album of all the 
image files is displayed (step S34). A judgment is then 
made to determined whether or not a file to be attached 
has been selected (step S36), and if a file has not been 
selected, return is made to step S34, the album display 



continuing. The selection of an image file to be attached, 
that is, the image to be used as the background image 
for a mail text, is performed by the user, who uses the 
cross (cursor) key 1 45 an the center key 1 46. 
[0038] If a file to be attached to an e-mail has been 
selected from the album display, the address indicating 
the location in which the selected image file is stored is 
stored into the file attachment address storage area of 
the working area 2921 , and the brightness of the image 
is judged based on the selected image file (step S38). 
A judgment is then made as to whether or not the bright- 
ness of the image is an intermediate value M (step S40). 
If the brightness of the image is the intermediate value 
M, brightness of the image is increased by a prescribed 
amount (step S46), after which the image is displayed 
overlaid over the body text created at step S22 (step 
S54). That is, a preview display is presented of the con- 
dition in which the display of the e-mail will be viewed 
at the receiving-side cell phone. 
[0039] If the brightness of the image was not the in- 
termediate value M, a judgment is made as to whether 
or not the image is brighter than the intermediate value 
M (step S42). If the image is brighter than the interme- 
diate value M, a further judgment is made as to whether 
or not the image brightness is between the intermediate 
value M and the threshold value TH1 (where intermedi- 
ate value M. < threshold value TH1) (step S44). If the 
brightness of the image is between the intermediate val- 
ue M and the threshold value TH1, after increasing the 
brightness of the image by a prescribed amount at step 
S46, flow proceeds to step S54, at which a preview dis- 
play is made of the body text of the e-mail created at 
step S22 with this image overlaid thereover. If the bright- 
ness of the image is greater than threshold value TH1, 
however, rather than adjusting the brightness of the im- 
age flow proceeds as is to step S54, at which a preview 
display is made of the body text of the e-mail created at 
step S22 with this image overlaid thereover. 
[0040] If the brightness of the image is darker than the 
intermediate value M, however, a judgment is made as 
to whether or not the image brightness is between the 
intermediate value M and the threshold value TH2 
(where intermediate value M > threshold value TH2) 
(step S48). If the brightness of the image is between the 
intermediate value M and the threshold value. TH2, the 
brightness of the image is decreased by a prescribed 
amount (step S50) and the color of displayed characters 
(in the e-mail text) is set to white (step S52). After this, 
a preview display is made of the body text of the e-mail 
created at step S22 with this image overlaid thereover 
(step S54). In the case in which the brightness of the 
image is darker than the intermediate value TH2, with- 
out adjusting the brightness of the image, the color of 
the displayed characters (in the e-mail text) is set to 
white (step S52), after which a preview display is made 
of the body text of the e-mail created at step S22 with 
this image overlaid thereover (step S54). 
[0041] As described above, at the preview display 
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made at step S54, after adjusting the brightness of the 
image that will be attached to the e-mail to the sent, the 
mail body text is displayed with an overlay of this image 
on the display 13. 

[0042] In the first embodiment of the present inven- 5 
tion, by judging the brightness of the image (which is to 
be attached to e-mail as a background image) in this 
manner, the brightness of the image to be displayed as 
a background for the e-mail is adjusted. Fig. 10 is a con- 
ceptual representation showing the image brightness 
for the purpose of illustrating the image brightness ad- 
justment. Fig. 11 is a schematic representation of an im- 
age with the image brightness of the intermediate value 
M a brightness between the intermediate value M and 
the threshold value TH1 (70% brightness) after the ad- 
justment of the brightness of the image, and an example 
of a display with the adjusted-brightness image overlaid 
by a mail text. ^ 

[0043] When the brightness of the image is the inter- 
mediate value M or between the intermediate value M 
and the threshold value TH1 (70% brightness) indicated 
in Fig. 1 0, processing is performed so as to increase the 
brightness (refer to the above-described step S46). Fig. 
11 (a) shows the original image, and Fig. 11 (b) shows 
the processed image. The e-mail body text created at 
step S22 is laid over the image of Fig. 11 (b) to create 
the preview display shown in Fig. 11 (c) (refer to the 
above-described step S54). 

[0044] If the brightness of the image is less than the 
intermediate value M shown in Fig. 10 and between the 
intermediate value M and the threshold value TH2 (30% 
brightness), processing is performed so as to decrease, 
the brightness of the image (refer to the above-de- 
scribed step S50). Fig. 12 is a schematic representation 
showing the original image, an image resulting from ad- 
justing the brightness of an image having a brightness 
less than the intermediate value M and between the in- 
termediate value M and the threshold value TH2 (30% 
brightness), and the brightness-adjusted image with the 
e-mail laid thereover. Fig. 12 (a) shows the original im- 
age, and Fig. 12 (b) shows the processed image. The 
e-mail body text created at step S22 is laid over the im- 
age of Fig. 12 (b) to create the preview display shown 
in Fig. 12 (c) (refer to the above-described step S54). 
[0045] In the case in which the user is satisfied with 
the preview display made at step S54, the user makes 
the entry (verification) operation (performs an operation 
which finalizes the content of the mail), but if the user is 
not satisfied with the preview display, the user can give 
an instruction to manually adjust the brightness of the 
image, or give instructions to change the locations of 
line breaks in the mail text or display position of the mail 
text. 

[0046] Therefore, the controller 22 next makes a judg- 
ment as to whether or not a user-made entry operation 
has been detected (step S56). If a user-made entry op- 
eration has been detected, the created mail data is 
stored in the send folder of the mail data storage area 



292 (step S58), after which a send instruction is given 
or a transition is made the send wait condition (step 
S60). 

[0047] In this embodiment, the processed image is 
stored in association with the mail text in the file attach- 
ment storage area 293. Therefore, at the storage 
processing of step S58, of the mail data being currently 
worked on stored in the working area 2921 , data other 
than the file attachment addresses, that is, destinations, 
subjects, mail body texts, and mail type flags (contents 
of the identification MTF flags) is stored in areas corre- 
sponding to the send folder 2922. In the file attachment 
address storage area of the send folder 2922 are stored 
addresses in the file attachment storage area 293 in 
which processed files are stored. The MTF identification 
flags in the send folder 2922 are set to the condition that 
indicates unsent mail ("0"). 

[0048] Mail data stored in the send folder 2922 (sub- 
jects and mail texts), when in the waiting condition of 
step S60 or thereafter when an instruction is given to 
send mail and this mail data is read out from the send 
folder, is sent to the specified destination along with an 
image specified by the file attachment address and the 
mail type flag MTF. When this is done, the time sent is 
stored in the sent date and time storage area of the send 
folder 2922, and the identification flag MSF is set to the 
condition indicating the sent condition ( H 1 w ). 
[0049] A cell phone having received this e-mail stores 
the received mail data in an area corresponding to the 
receive folder 2923, and stores the time of receipt in the 
date/time received storage area. When this is done, the 
MRF identification flag in the receive folder 2923 is set 
to the condition indicating not display (not verified) ("0"). 
In this case, because the MTF mail type flag of the re- 
ceived mail indicates that the e-mail has an image 
(background image), when it is read out of the receive 
folder 2923 and displayed, the image attached to the 
mail is displayed as a background image, with the mail 
body text overlaid thereover. 

[0050] In the case in which at step S56 there was no 
entry operation detected, the detection is made of 
whether or not an instruction has been given for a man- 
ual adjustment (step S62), as well as detection of wheth- 
er or not an instruction is given to correct the mail body 
text (step S80). If an instruction to make manual adjust- 
ment of the brightness of the image is detected, the im- 
age brightness is manually adjusted (step S64). A judg- 
ment is again made to see whether or not a user-made 
entry operation has occurred (step S66). If the entry op- 
eration has not been made, return is made to step S64, 
and manual adjustment continues. 
[0051] If an entry operation has made after manual 
adjustment, judgment is made of the brightness of the 
image after adjustment (step S68), and a judgment is 
made as to whether or not the image brightness is the 
intermediate value M (step S70). In the case in which 
the image brightness is not the intermediate value M, a 
further judgment is made as to whether or not the image 
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brightness is greater than the intermediate value M (step 
S72). If the image brightness after adjustment is greater 
than the intermediate value M, at step S47 the color of 
the displayed characters (of the mail text) is set to black, 
and then return is made to the above-described step 5 
S47, at which a preview display is made of the body text 
overlaid on the image. 

[0052] In the case in which the brightness of the image 
after manual adjustment is the intermediate value M, at 
step S74 the color of displayed characters (of the mail 
text) is set to black, and then return is made to the 
above-described step S54, at which a preview display 
is made of the image with the body text overlaid there- 
over. 

[0053] If the image brightness after manual adjust- 
ment is darker than the intermediate value M, at step 
S76 the color of displayed characters of the body text of 
the mail is set to white, after which return is made to the 
above-described step S54, at which an overlaid preview 
display is made of the mail text and the image. 
[0054] By manual adjustment of the image brightness 
if the image brightness crosses over the intermediate 
value M by the change, the color of the characters in the 
mail text is changed. If the user makes an entry opera- 
tion (thereby finalizing the content of the mail), as de- 
scribed above mail data undergoing work is stored in 
the send folder 2922 of the mail data storage area 292 
(step S56). 

[0055] At step S78, in the case in which an instruction 
to correct (edit) the mail text is detected, keeping the 
display of the background image unchanged, correction 
of the position of carriage returns in the mail text or cor- 
rection of the display position of the mail text, or correc- 
tion of the mail text itself is performed (step S80). The 
position of a carriage return in the mail text is corrected, 
by inserting or deleting a carriage return in the mail text. 
The display position of the mail text is corrected by in- 
serting a carriage return code or a space code at the 
head of the mail text. Another detection is made of 
whether or not the user has made an entry operation 
(step S82). If the entry operation had not been made, 
return is made to step S80, and mail text editing contin- 
ues. 

[0056] In the case in which, at step S78, there is no 
detection of an instruction to edit the mail text, and in 
the case in which, at step S82, an entry operation is de- 
tected, return is made to the above-described step S54, 
at which an overlaid preview display is made of the mail 
text and the image. 

[0057] Fig. 13 is a flowchart illustrating the received 
mail display processing in the first embodiment of the 
present invention. Received mail display processing 
comes under the category of "other processing" as not- 
ed at step S12 in the flowchart of Fig. 7, and the flow- 
chart shown in Fig. 13 is the branch from the "NO" result 
at step S10 in Fig. 7. 

[0058] In the case in which a selection is made other 
than to create a new e-mail, a judgment is made as to 



whether or not the receive folder is selected (step S90), 
and if the receive folder is not selected, flow proceeds 
to other processing (step S92). In the case in which the 
receive folder is selected, however, the received list is 
displayed so as to display a list of received e-mail (step 
S94). 

[0059] Fig. 1 4 is a schematic representation of an ex- 
ample of a received list (In Box) display on the main dis- 
play 1 3. The icon 1 301 represents the amount of battery 
charge, and the icon 1 302 represents the radio receiving 
condition. In the received list, the icons 1303 to 1306 
provide a view of read/unread statuses of each e-mail. 
More specifically, the icon 1 303 is an icon that is dis- 
played when the identification flag MTF is "0" and also 
the identification flag MRF is "0", meaning that the e- 
mail is unread e-mail. The icon 1304 is displayed when 
the receive folder 2923 identification flag MTF is "1" and 
also the identification flag MRF is "0", meaning that the 
e-mail is an unread e-mail with a background image. 
The icon 1305 is an icon that is displayed when the re- 
ceive folder 2923 identification flag MTF is "0" and also 
the identification flag MRF is "1", meaning that the e- 
mail has been read. The icon 1306 is an icon that is dis- 
played when the receive folder 2923 identification flag 
MTF is "1" and also the identification flat MRF is "1", 
meaning that the e-mail is an embodiment with a back- 
ground image that has already been read. 
[0060] From this display, the user performs a selec- 
tion operation to make a selection from the list of an e- 
mail to be displayed. The controller 22, based on the 
identification flag MTF (contents) of the selected em- 
bodiment, whether or not a mail with a background im- 
age has been selected (step S96). If an e-mail with a 
background image has not been selected, flow pro- 
ceeds to normal mail processing (step S98). 
[0061] In the case in which the selected e-mail has a 
background image, the mail text thereof is displayed 
with the attached image as the background on the main 
display 13 (step S100). Next, a judgment is made as to 
whether or not a cancel operation has be detected (step 
S102), and if a cancel operation has been detected, re- 
turn is made to step S94, thereby transitioning to the 
received list display. 

[0062] In the case in which a cancel operation has not 
been detected, a check is made to see whether or not 
an ending operation has been detected (step S104) and 
if the ending operation has been detected, return is 
made to the main menu. 

[0063] If an ending operation was not detected, a 
check is made as to whether or not a key 143 operation 
has been made, which is a judgment as to whether or 
not a display instruction has been given for a back- 
ground image (step S106). If a key 143 operation was 
not made, return is made to step S100, and the display 
of the image with the superimposed mail text is contin- 
ued. 

[0064] In the case in which the key 1 43 operation was 
made, the mail text display is gradually removed, until 
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the display is that of only the background image as 
shown in Fig. 10 (b) (step S1 08). Next, a check of wheth- 
er or not the key 143 operation was made is done once 
again (step S110). In the case in which a key 143 was 
made, return is made to step S108, and the image dis- 5 
play is continued. If a key 143 operation is made while 
the image is being displayed, however, return is made 
to step S100, at which the mail text slowly appears in 
the display, after which the display has the mail text 
overlaid over the background image. 
[0065] That is, each time the key 143 operation is 
made, an alternating switched display is made of the im- 
age with the mail text overlaid (refer to Fig. 10 (c)) and 
the image (Fig. 10 (b)). 

[0066] In the case in which at step S106 there is no 
detection of a key 143 operation, rather than directly re- 
turning to step S108, it is possible to provide a step that 
detects an operation of another prescribed key, in which 
case if operation of that key is detected, the display of 
the background image is gradually removed, so that dis- 
play is mad of only the mail text. In this case as well, 
return to step S100 is made when detection is made of 
another operation of the other prescribed key. If this is 
done, not only is there switching between the display of 
the image overlaid with the mail text (refer to Fig. 10 (c)) 
and the display of the image (Fig. 10 (b)), but it is also 
possible to make switching between a display of the im- 
age overlaid with the mail text (refer to Fig. 19 (c)) and 
the display of the mail text only, thereby enabling certain 
visual verification, as required, of either the background 
image or the mail text. 

[0067] A second embodiment of the present invention 
is described below. In this second embodiment, be- 
cause the system configuration, outer appearance of 
the cell phone, and major aspects of the cell phone con- 
figuration are similar to the first embodiment, there de- 
scriptions will be omitted herein. 
[0068] Fig. 15 is a conceptual representation of the 
configuration of the memory areas in the ROM 24 of a 
cell phone in the second embodiment of the present in- 
vention. Elements corresponding to elements in Fig. 4 
are assigned the same reference numerals as in Fig. 4, 
and are not described herein. ROM 24 is formed by a 
mail software program area 241 , an image processing 
program area 2416, a template file storage areas 2417, 
and an other program area 2414. 
[0069] The mail software program area 241 is sepa- 
rated into a mail software program area 2411 into which 
is stored a known general mail software program, and 
a background image display handling mail software pro- 
gram area 2412 into which is stored a background im- 
age display handling mail software program. The back- 
ground image display handling mail software program 
can also be downloaded from WWW5. 
[0070] The template file storage area 2417 is an area 
into which is stored a template file (filtering function file) 
required to add special effects (such as changing the 
image brightness, soft focus, and changing the image 



color to sepia) based on an image processing program 
at the time of displaying an image. The template file stor- 
age area 2417 in the second embodiment is used to 
store at least a plurality of template files having different 
brightnesses. In the second embodiment, rather than 
performing processing of the brightness of an attached 
image itself, a filtering function (template file) that 
changes the brightness is displayed is overlaid in the 
display region in which the mail text, thereby changing 
the brightness of the background image. More specifi- 
cally, based on brightness correction data established 
by each template file, correction is done of the bright- 
ness of the background image displayed in the display 
region for displaying the mail text. 
[0071] Fig. 16 is a conceptual representation illustrat- 
ing the overlaying processing of the image and the tem- 
plate file in the second embodiment. In the case in which 
the brightness of the image a is greater than the thresh- 
old value TH1, a transparent background template file 
(character color: black) e, that is, a template file having 
a brightness correction value of 0 and also setting the 
character display color to black is overlaid. 
[0072] In the case in which the brightness of image b 
is greater than the intermediate value M and less than 
the threshold value TH1 , or is the intermediate value M, 
a increased brightness template file (character color: 
black) f, this being a template file having a positive 
brightness correction value and also setting the charac- 
ter display color for the mail text to black is overlaid. 
[0073] In the case in which the brightness of the image 
c is less than the intermediate value M and greater than 
the threshold value TH2, a decreased brightness tem- 
plate file (character color: white) g, this being a template 
file having a negative brightness correction value and 
also setting the character display color for mail text for 
white is overlaid. 

[0074] In the case in which the brightness of image d 
is less than the threshold value TH2, a transparent back- 
ground template file (character color: white) h, this being 
a template file with a bright correction value of 0 and 
which also sets the character display color for mail text 
to white is overlaid. 

[0075] Essentially, in the second embodiment of the 
present invention, rather than processing so as to 
change the brightness of the image itself, correction is 
done of the displayed brightness of an image, based on 
brightness correction data established by each template 
file. In the second embodiment, therefore, it is possible 
to attach the original image to the e-mail as is. In this 
case, it is necessary to add to the mail information spec- 
ifying the template file, this specifically being the addi- 
tion of the template file number. Because of this, the sec- 
ond embodiment of the present invention is provided 
with a template number storage area in the mail data 
storage area 292. 

[0076] Fig. 17 is a conceptual representation of the 
configuration of the mail data storage area in this em- 
bodiment. Comparing the configuration of the mail data 
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storage area 292 in this embodiment with the configu- 
ration of the mail data storage area in the first embodi- 
ment shown in Fig. 6, the mail data storage area 292 in 
the second embodiment is the same as the mail data 
storage area 292 of the first embodiment, with the ex- 5 
ception of the addition of the template number storage 
area. 

[0077] Because whether or not a received e-mail has 
a background image attached can be judged by whether 
or not a template number has been added to the mail, 
the signal configuration of an e-mail with a background 
image can be made a signal configuration to which mail 
type identification information is not added. In this case, 
the region shown in Fig. 17 for storing the mail type iden- 
tification information provided in the mail data storage 
area 292 is not absolutely needed. 
[0078] The operation of the second embodiment is 
described below. In this description Fig. 18 and Fig. 19 
collectively form a flowchart illustrating the mail creation 
processing in the second embodiment. Because the 
processing prior to the flowchart shown in Fig. 18 and 
Fig. 1 9 (creation and image selection) is the same as in 
steps S10 to S36 of Fig. 7 and Fig. 8, these are not de- 
scribed herein. 

[0079] In performing mail creation processing, at step 
S36 of Fig. 8 when an image to attach to an e-mail is 
selected from the album display, the brightness of the 
selected image is distinguished (step S120). Then a 
judgment is made as to whether or not the image bright- 
ness is the intermediate value M (step S122). If the im- 
age brightness is the intermediate value M, the in- 
creased-brightness filter template file (character color: 
black) is read out (step S128). The display brightness 
of the image is corrected based on the read out template 
file, and an overlaid display (preview display) is made 
(step S128) of the brightness-corrected image with the 
mail text created at step S22 laid thereover. 
[0080] If the image brightness is not the intermediate 
value M, a judgment is made as to whether or not the 
image brightness is greater than the intermediate value 
M (step S124 and, if it is greater than the intermediate 
value M, a further judgment is made as to whether or 
not the image brightness is between the intermediate 
value M and the threshold value TH1 (where intermedi- 
ate value M < threshold value TH1) (step S126). If the 
image brightness is between the intermediate value M 
and the threshold value TH1, an increased-brightness 
filter template file (character color: black) is read out 
(step S128) the same as is done in the case in which 
the image brightness is the intermediate value M, the 
image display brightness is corrected based on the read 
out template file, and an overlaid preview display is 
made (step S128) of the brightness-corrected image 
with the mail text created at step S22 laid thereover. If 
the image brightness is not between the intermediate 
value M and the threshold value TH1, that is, if it is 
brighter than the threshold value TH1, a transparent 
background template file (character color: black) is read 



out (step S1 30). Because this template has a brightness 
correction value of 0, without performing correction of 
the image brightness, the overlaid preview display is 
made (step S 128) of the uncorrected image with the mail 
text created at step S22 laid thereover. 
[0081] If the image brightness is less than the inter- 
mediate value M, however, a judgment is made as to 
whether or not the image brightness is between the in- 
termediate value M and the threshold value TH2 (where 
intermediate value M > threshold value TH2) (step 
S132). If the image brightness is between the interme- 
diate value M and the threshold value TH2, a reduced- 
brightness filter template file (character color: white) is 
read out (step S134). The display brightness of the im- 
age is corrected based on the read-out template file and 
the mail text character color is set to white, after which 
an overlaid preview display is made (step S128) of the 
brightness-corrected image with the mail text created at 
step S22 laid thereover. If the image brightness is not 
between the intermediate value M and the threshold val- 
ue TH2, that is, if the image brightness is darker than 
the threshold value TH2, a transparent background tem- 
plate file (character color: white) is read out (step S1 36). 
Because the brightness correction value of this template 
is 0, without performing correction of the display bright- 
ness of the image, the mail text display character color 
is set to white, after which an overlaid preview display 
is made (step S138) of the brightness-corrected image 
with the mail text created at step S22 laid thereover. 
[0082] As described above, in the preview display 
made at step S1 38 a template file for overlay is selected 
by means of distinguishing the brightness of the original 
image, and the brightness correction and setting of the 
displayed character color are done based on the select- 
ed template, after which an overlaid preview is made on 
the display 13 with the image and mail text overlaid. 
[0083] Next, a judgment is made as to whether or not 
a user entry instruction (instruction to finalize the mail 
content) has been detected (step S140). If the user entry 
instruction is detected, the mail data currently being 
worked on is stored in the send folder 2922 of the mail 
data storage area 292 (step S142), after which transition 
is made to the send wait condition or a wait for an end 
instruction (step S144). 

[0084] In this embodiment of the present invention, 
the configuration is such that the original image itself 
and the template number are added to the mail text and 
sent, the original image being stored in association with 
the mail text into the file attachment storage area 293. 
[0085] Therefore, at the storage processing of step 
S142 of the mail data being created and stored in the 
working area 2921, data other than the file attachment 
addresses, that is, destinations, subjects, mail body 
texts, and MTF mail type flags, and template numbers 
is stored in areas corresponding to the send folder 2922. 
In the file attachment address storage area of the send 
folder 2922 are stored addresses in the file attachment 
storage area 293 in which the above-described original 
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images are stored. The MSF identification flags in the 
send folder 2922 are set to the condition that indicates 
unsent mail CO"). 

[0086] Mail data stored in the send folder 2922 (sub- 
jects and mail texts), when in the waiting condition of 
step S 144 or thereafter when an instruction is given to 
send mail and this mail data is read out from the send 
folder 2922, is sent to the specified destination along 
with an image specified by the file attachment address 
and the mail type flag MTR When this is done, the time 
sent is stored in the sent date and time storage area of 
the send folder 2922, and the identification flag MSF is 
set to the condition indicating the sent condition ("1"). 
[0087] A cell phone having received this e-mail stores 
the received mail data in an area corresponding to the 
receive folder 2923, and stores the time of receipt in the 
date/time received storage area. When this is done, the 
MRF identification flag in the receive folder 2923 is set 
to the condition indicating not display (not verified) ("O"). 
In this case, because the mail type flag of the received 
mail indicates that the e-mail has an image (background 
image), when the mail is read out of the receive folder 
2923 and displayed, the image attached to the mail is 
displayed as a background image after compensation 
based on the template number, and the mail text is dis- 
played thereover in a color specified by the template 
number. 

[0088] The signal configuration of an e-mail with a 
background image is one in which mail type identifica- 
tion information is not added, and in the case in which 
no area is provided in the receive folder 2923 for storing 
the mail type identification flag MTF, based on whether 
or not there is data in a template number storage area 
a judgment is made as to whether or not the mail is a 
mail with an attached background image, processing 
being performed as to whether or not to use the image 
attached thereto as a background image. 
[0089] In the case in which at step S 140 an entry in- 
struction is not detected, detection is performed as to 
whether or not an instruction is given to correct the im- 
age brightness (step S146). If an instruction to correct 
the image brightness is detected, template switching 
processing is performed manually (step S148). Then an 
judgment is made once again as to whether or not an 
entry instruction is detected (step S150). If an entry in- 
struction is detected, return is made to step S148, and 
the template switching processing is continued. If an en- 
try instruction is detected, return is made to step S138, 
and after setting the image brightness and mail text 
character display color based on the step S1 48 selected 
template, an overlaid preview display is made of the mail 
text and the image. 

[0090] In the case in which at step S146 it was not 
possible to detect an instruction for image brightness 
correction, detection is performed of whether or not an 
instruction is made to edit the mail text (step S152). At 
step S1 52 if an instruction to edit the mail text is detect- 
ed, with the background image display remaining as is, 



correction of carriage return positions in the mail text 
and display positions, or editing of the mail text itself is 
done (step S154). Then once again a judgment is made 
as to whether or not an entry instruction is detected is 
5 made (step S156). If no instruction is given, return is 
made to step S1 54, and the mail text editing continues. 
[0091] In the case in which an entry instruction is de- 
tected a step S156, return is made to the above-de- 
scribed step S1 38, at which an overlaid preview display 
is made of the mail text and the image. 
[0092] In the case in which an instruction to edit the 
mail text is detected at step S152, a judgment is made 
as to whether or not a key 143 operation is made, that 
is, whether an instruction to display the background im- 
age has been made (step S158). In the case in which a 
key 143 operation was not made, return is made to step 
S138, and the preview display is continued. 
[0093] If a key 143 operation is made, however, the 
original image shown in Fig. 11 (a) is displayed. Next, a 
judgment is made again as to whether or not a key 143 
operation is made (step S162), In the case in which a 
key 143 operation is not made, return is made to step 
S160, and the preview display is continued. If a key 143 
operation is made with the original image displayed, 
however, return is made to step S1 38, at which the pre- 
view display is made. 

[0094] That is, when making the preview display it is 
possible to adjust the brightness of the background im- 
age, or to edit the mail text and verify the original image 
or the like. 

[0095] Although this embodiment is described for an 
example in which there are 3 original image brightness 
judgment levels and in which 4 types of templates are 
used, it will be understood that it is possible in the 
present invention to use a larger number of original im- 
age brightness judgment levels or a greater number of 
types of template files. If this is done, it is possible to 
make the image brightness after correction using a tem- 
plate come close to a desired brightness (for example, 
the threshold values TH1 or TH2 shown in Fig. 10). 
[0096] The processing for displaying received mail in 
the second embodiment is described below. Since this 
processing is substantially the same as the processing 
for displaying received mail in the first embodiment 
shown in Fig. 12, the description will be made with ref- 
erence to Fig. 1 3. 

[0097] The processing for displaying received mail in 
the second embodiment, in the same manner as the re- 
ceived mail display processing in the first embodiment, 
50 is done by selecting the receive folder from the mail 
menu display condition so as to display a list of received 
mail (step S90 to step S94). 

[0098] When the user selects a mail to be displayed 
from the received mail list, the controller 22 makes a 
55 judgment, based on the value of the MTF identification 
flag of the selected mail as to whether or not a mail with 
a background image has been selected (step S96). In 
the case in which an MTF mail identification flag storage 
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area is not provided in the receive folder 2923, a judg- 
ment is made as to whether or not an e-mail with a back- 
ground file attached is selected, based on number data 
in the template number storage area of the selected 
mail. 

[0099] In the case in which a mail with a background 
image is not selected, flow proceeds to normal mail 
processing (step S98), but in the case in which mail with 
a background image is selected, flow proceeds to 
processing that sets the attached image as the back- 
ground and displays the mail text on the display 1 3 (step 
S100). In this display processing, the brightness of the 
image to be displayed as the background is corrected 
and the color of the characters displayed are set based 
on the template specified by the number of the template 
attached to the mail. 

[01 00] Next, a judgment is made as to whether or not 
a cancel operation has been made by the user (step 
S102), a judgment is made as to whether and ending 
operation has been made (step S104), and a judgment 
is made as to whether or not a key 143 operation has 
been made, these judgments being made in this se- 
quence, and if none of these operations has been made, 
return is made to step S1 00, and the display of the image 
with the mail text overlaid thereover is continued. 
[0101] In the case in which, at step S102, the cancel 
operation is detected, return is made to step S94, and 
in the case in which an ending operation is detected at 
step S1 04, return is made to the mail menu display. If 
the key 143 operation is made at step S106, transition 
is made to display of only the background image at step 
S108. Whereas in the first embodiment, because an im- 
age attached to an e-mail for use as a background im- 
age is a brightness-adjusted image, at the image display 
at step S108 is a brightness-adjusted image, such as 
shown in Fig. 1 0 (b), in the second embodiment because 
the original image is itself attached to the e-mail, the 
original image is displayed, as shown in Fig. 10 (a). That 
is, in the in which there is an operation of the key 143, 
the mail text display is gradually removed, defocused, 
or faded out, and a gradual transition is made from the 
brightness-adjusted image shown in Fig. 10 (b) to the 
original image as shown in Fig. 10 (a), by having the 
brightness of the displayed image approach the bright- 
ness of the original image. 

[01 02] Next, a judgment is made as to whether or not 
a key 143 operation is made (step S110) and, if a key 
143 operation is not made, return is made to step SI 08, 
and the image display is continued. If a key 143 opera- 
tion is made with the image displayed, however, return 
is made to step S100, the brightness of the displayed 
image being gradually changed to the brightness spec- 
ified by the template, and the mail text being gradually 
displayed or faded-in, so that an overlaid display of the 
mail text on the image is made. 
[0103] Thus, each time the key 143 operation is 
made, an alternating display is made so that there is 
gradual switching between a display onto which the mail 



text is overlaid (refer to Fig. 10 (c)) and the original im- 
age (Fig. 10(a)). 

[0104] In the second embodiment as well, in the case 
in which a key 143 operation is not detected at step 

5 S1 06, rather than returning directly to step S1 08 a step 
that detects the operation of another prescribed key can 
be provided, and if that other key operation occurs, the 
original image display is removed, so that only the mail 
text is displayed. In this case as well, the return to step 

10 S1 00 is made when the additional operation of the pre- 
scribed other key is detected. By doing this, because 
not only is it possible to make a switched display be- 
tween the image with the overlaid mail text (refer to Fig. 
1 0 (c)) and the display of the original image (Fig. 1 0 (a)), 

15 but it is also possible to make a switched display be- 
tween the image with the overlaid mail text (refer to Fig. 
1 0 ((c)) and the display of the mail text only, it is possible 
as required to make certain visual verification of either 
the background image or the mail text. 

20 [0105] A third embodiment of the present invention is 
described below, 

[01 06] The third embodiment of the present invention 
is a method for sending an original image itself in the 
case in which an image is attached to a mail text, and 

25 also a method for sending, attached to the mail text, in- 
formation (flag information) that gives an instruction to 
display the attached image as a background image of a 
mail text and brightness correction data for use when 
displaying the attached image as a background image 

30 in the case in which an attached image is displayed as 
a background image of a mail text on the receiving-side 
display. By doing this, in the case of making a setting at 
the receiving side that uses an attached file as a back- 
ground image, the brightness of the attached image is 

35 corrected in accordance with the attached brightness 
correction data and used as the background image for 
the mail text. 

[0107] In this third embodiment, because the system 
configuration, outer appearance of the cell phone, and 
40 major aspects of the cell phone configuration are similar 
to the first embodiment, there descriptions will be omit- 
ted herein. 

[0108] The configuration of the third embodiment will 
now be described. Fig. 20 is a conceptual representa- 

45 tion of the configuration of the memory areas of the ROM 
24 of a cell phone according to the third embodiment. 
Elements corresponding to elements in Fig. 4 are as- 
signed the same reference numerals as in Fig. 4, and 
are not described herein. ROM 24 is formed by a mail 

50 software program area 2411 , an image processing pro- 
gram area 2416, and an other program area 2414. Thus, 
whereas the first embodiment and the second embodi- 
ment have configurations in which two types of mail soft- 
ware programs (that is, a normal mail software program 

55 and a background image display handling mail software 
program), in the third embodiment there is only one time 
of mail software program. 

[0109] Fig. 21 is a conceptual representation of the 
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configuration of the mail data storage area 292 in this 
embodiment. Comparing the configuration of the mail 
data storage area 292 in this embodiment with the con- 
figuration of the mail data storage area in the first em- 
bodiment shown in Fig. 6, the mail data storage area 
292 in the third embodiment is the same as the mail data 
storage area 292 of the first embodiment, with the ex- 
ceptions that in the mail data storage area 292 of the 
third embodiment, in place of the area for storage of the 
mail type identification information MTF, and area is pro- 
vided for storage of a BDF identification flag, which in- 
dicates whether or not an image attached to an e-mail 
is to be displayed as the background image of the mail, 
and also that there is provided an area for storage of a 
correction value for correcting the brightness of the im- 
age when displaying an image attached to an e-mail as 
the background image for the mail. 
[0110] The operation of the third embodiment of the 
present invention is described below, taking the opera- 
tion when creating an e-mail first. 
[01 1 1] Fig. 22 is a flowchart illustrating the mail crea- 
tion processing in the third embodiment. The flowchart 
of Fig. 22 starts from the condition in which the mail 
menu is being displayed. 

[01 1 2] First, a judgment is made as to whether or not 
an instruction has been given from the mail menu to cre- 
ate a new e-mail (step S1 70) In the case in which an 
instruction to create a new e-mail is not detected, the 
flow transitions to other processing (step S172). 
[0113] If an instruction to create a new e-mail is de- 
tected, however, a menu screen for creating an e-mail 
is displayed on the display 13 (step S174). This menu 
screen displays data that must be input to create an e- 
mail, such as the destination, the subject, the mail text, 
and a file attachment and the like. 
[0114] Next, when data is input for selected items or 
a file to be attached is selected, the data for each of the 
input items is stored in an area corresponding to the 
items in the working area 2921 , and the input data (data 
of each item) is displayed on the display 1 3 (step S1 76). 
[0115] At this stage, the user can either select the 
sending of the file selected as a file attachment at the 
step S176 as a normal file attachment or select the 
sending of the file attachment as a background image 
for the mail text. In the case in which the user wishes to 
send the image file as a normal file attachment, an entry 
(verification) instruction is given, and if the user wishes 
to sent the image file as the background image of the 
mail text, the user performs an instruction for an back- 
ground image. 

[01 1 6] Therefore, the controller 22 makes a judgment 
as to whether or not an entry (verification) instruction 
has been given for the input data (step S178). In the 
case in which the entry instruction is given, the mail data 
currently being worked with is stored into the send folder 
2922 of the mail data storage area 292 (step S1 80), after 
which a wait is made for either a send instruction or an 
ending instruction (step S182). 



[0117] In the third embodiment, as described above, 
in the case in which an image is attached to an e-mail, 
the method used is that of attaching the original image 
itself, and also sending information (flag information) 
5 that indicates that an attached image is to be used as 
the background image for the mail text and brightness 
correction data for display of the attached image as the 
background image. 

[0118] In the storage processing at step S180, there- 
to fore, of the mail data currently being worked on stored 
in the working area 2921 , data other than the file attach- 
ment address, this being the destination, the subject, the 
mail text, the BDF background image display identifica- 
tion flag, and image brightness correction value, is 

15 stored in corresponding areas in the send folder 2922. 
The address in the file storage area 293 into which the 
original image is stored is stored in the file attachment 
address storage area of the send folder 2922. At this 
stage, however, even if there is an image attached to 

20 the mail, the setting of this image as a background im- 
age for the mail text has not yet been made, the infor- 
mation of BDF background image display identification 
flag of the working area 2921 is information (the value 
0) that indicates that a background image display is not 

25 to be made, and the image brightness correction value 
has not been set. Therefore, information is set into the 
BDF background image display identification flag (the 
value 0) indicates that a background image display is 
not to be made, and the image brightness correction val- 

30 ue remains unset. The MSF identification flag of the 
send folder 2922 is set to the unsent condition (0). 
[0119] In the case, however, in which at step S178 
there is no detection of an entry (verification) operation 
in the input data, detection is made of whether or not a 

35 background image display instruction has been made 
(step S184). In the case in which a background image 
display instruction is not detected, return is made to step 
S176. If a background image display instruction is de- 
tected, however, detection is made as to whether or not 

40 an image file was attached at step S176 (step S186). In 
the case in which an image file had not been attached, 
an error display is made (step S188), this error display 
being maintained until the user makes a verification op- 
eration at step S190, and when the user-made verifica- 

45 tion operation is detected, return is made to step S1 76. 
[0120] When the presence of an attached image file 
is detected at step S1 86, the attached image file is dis- 
played on the display 13 and user adjustment of the im- 
age brightness is permitted (step S192). When the user 

50 adjusts the brightness of the displayed image, the ad- 
justment value (correction value with respect to the 
brightness of the original image) is stored in the correc- 
tion value storage area of the working area 2921. The 
display brightness correction of the image is continued 

55 until the user indicates the end of adjustments, at which 
point the correction value stored in the correction value 
storage area of the working area 2921 is also updated. 
When the user indicates the end of adjustments, an 
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overlaid display of the mail text with the display bright- 
ness corrected image is made (preview display) (step 
S194). 

[0121] If the user views the preview display at step 
S194 and is satisfied with the display, the user makes 
an entry (verification) operation. If the user is not satis- 
fied with the displayed preview, however, the user can 
re-adjust the displayed brightness of the background im- 
age, adjust the mail text, or cancel the background im- 
age display 

[0122] In the condition with the preview display shown 
on the screen, the controller 22 performs a detection of 
whether or not a re-adjustment instruction is given (step 
S196), a detection of whether or not a text edit instruc- 
tion is given (step S198), a detection of whether or not 
a cancel instruction is given (step S200), and a detection 
of whether or not an entry instruction is given (step 
S202). 

[0123] If at the step S196 a re-adjustment instruction 
is detected, return is made to the display bright adjust- 
ment processing of step S192. If a text edit instruction 
is detected at step S1 98, the same text editing process- 
ing is performed as at step S80 in Fig. 9 (step S204), 
after which return is made to the preview display of step 
S194. 

[01 24] If a cancel instruction is detected at step S200, 
the correction value stored in the correction value stor- 
age area of the working area 2921 is cleared, and return 
is made to the item data input and display processing of 
step S1 76. 

[0125] If an entry instruction is detected at step S202, 
the BDF background image display identification flag is 
set to "1" (step S206), after which the storage process- 
ing of step S180 is executed. After the processing of 
step S206, at the storage processing of step S180, be- 
cause the information of the BDF background image 
identification flag in the working area 2921 is information 
indicating the making of a background image display 
("1"), of the mail data currently being worked on in the 
working area 2921, ail data with the exception of the at- 
tached file address is stored in the corresponding areas 
of the send folder 2922. Into the file attachment address 
storage area of the send folder 2922 is stored the ad- 
dress in the file attachment storage area 293 in which 
the above-noted original image is stored. 
[0126] If an instruction to send occurs in the waiting 
condition of step S 182 or thereafter in the condition in 
which mail data is read out from the send folder 2922, 
the mail data (subject and mail text) stored in the send 
folder 2922 is sent to the specified destination, along 
with the image brightness correction value and the BDF 
background image display identification flag. When this 
is done, the time sent is stored into the date and time 
sent storage area of the send folder 2922, and the SDF 
identification flag is set to "1" to indicate the sent condi- 
tion. 

[0127] The cell phone that receives the above-noted 
mail stores the received mail data in a corresponding 



area of its receive folder, and records the time of receipt 
in the received date and time storage area. When this 
is done, the MRF identification flag is set to "0" to indi- 
cate that the mail has not yet been read. In this case, if 
5 the BDF background image identification flag of the re- 
ceived mail is "1", because this indicates the attached 
image is to be displayed as a background to the mail 
text, when the mail is read from the receive folder 2923 
and displayed, the brightness of the attached to the mail 
is first adjusted in accordance with the brightness of the 
attached image and then displayed as the background 
image, over which the mail text is displayed. 
[0128] The signal configuration of an e-mail with a 
background image is one in which background image 
display identification flag information is not added, and 
in the case in which no area is provided in the receive 
folder 2923 for storing the BDS background image dis- 
play identification flag, based on whether or not there is 
data in an image brightness correction value storage ar- 
ea, a judgment is made as to whether or not the mail is 
a mail with an attached background image, processing 
being performed as to whether or not to use the image 
attached thereto as a background image. 
[0129] Although this embodiment of the present in- 
vention is for the case in which the mail text is superim- 
posed over the image after processing to adjust the 
brightness of an image has been completed so as to 
make a preview display, it will be understood that it is 
alternatively possible to display the mail text on the 
background image at the time of display brightness ad- 
justment processing of the image at step S192, in which 
case it is not necessary to make the preview display at 
step S194, and an instruction by the user to end the ad- 
justment is detected as an entry instruction at the step 
S196. 

[0130] Next, the mail receiving processing in the third 
embodiment will be described. Mail receiving process- 
ing in the third embodiment is substantially the same as 
in the first and second embodiments of the present in- 
vention. The receiving processing in the third embodi- 
ment is different from the mail receiving processing of 
the first and second embodiments in that the detection 
processing to determine whether or not a mail with a 
background image is selected at step S96 of the flow- 
chart of Fig. 1 3 is done by either by the information (val- 
ue) of the BDF identification flag of the selected mail, or 
by whether or not there is a brightness correction value, 
in that an image that has a brightness corrected based 
on an image brightness correction value attached to the 
mail is used as the background image in the mail text 
display at step S100, and in that in the image display at 
step S108 the image attached to the mail itself is dis- 
played. 

[0131] Additionally, although in this embodiment, the 
display of the background image of the mail text is done 
by performing correction in accordance with the bright- 
ness of the original image, it is alternatively possible to 
adopt a system of using a template, as in the case in the 
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second embodiment, in which case the ROM 24 of the 
cell phone can be provided with a template file storage 
area, such as shown in Fig. 23, selection processing to 
select a template for use in display brightness adjust- 
ment of the image being performed at step S1 92 of the 5 
mail creation processing, and in mail sending process- 
ing the number of the template selected being sent in 
place of the image brightness correction value. 
, [0132] A fourth embodiment of the present invention 
is described below. 

[0133] In contrast to the first to third embodiments of 
the present invention, in which, after launching the mail 
mode by a mail key operation from the wait condition 
the new mail creation mode is selected from the mail 
menu, after which selection is made of a background 
image from the new mail creation mode, or an attached 
image is specified as the background image, after which 
sending was done, in the fourth embodiment of the 
present invention, when an image photographed by the 
camera module is being displayed, or when an image is 
read out from an image file, selection is made of sending 
from a sub-menu of this mode, or the mail key is oper- 
ated to. enter the mail creation mode, and specify and 
send a displayed image as the background image for 
the mail text. 

[0134] In the fourth embodiment, similar to the case 
of the third embodiment, the system used is one of send- 
ing the original image itself as a file attachment to the 
mail text, and one in which, in addition to attaching an 
image that had been displayed to an e-mail, information 
(flag information) indicating that the attached image is 
to be used as the background image for the mail text 
and brightness correction data for display of the at- 
tached image as a background image are attached to 
the mail before sending the mail. By doing this, the 
brightness of the attached image is corrected at the re- 
ceiving side based on attached brightness correction 
data and the corrected image used as the background 
image for the body text. Because the system configura- 
tion, outer appearance of the cell phones, and general 
configuration of the cell phones are the same as in the 
first embodiment, they are not described herein. 
[0135] The configuration of the fourth embodiment in 
terms of the ROM 24 and the mail data storage area 292 
and the like can be the same as that of the third embod- 
iment. 

[0136] The operation of the fourth embodiment of the 
present invention is described below, taking first the 
case of mail creation processing. 
[0137] Fig. 24 is a flowchart illustrating the processing 
of mail creation in the fourth embodiment. This flowchart 
starts from the condition in which a screen that displays 
an image captured by the camera module or read in from 
an image file is displayed by the display 13. 
[0138] In this display condition, a judgment is made 
as to whether or not an instruction is made to send (step 
S21 0). More specifically, this judgment is a judgment as 
to whether or not sending has been selected from a sub- 



menu of the image mode, or a judgment as to whether 
or not a mail key 141 operation is made in the image 
mode. 

[0139] If the send instruction is detected, the mail cre- 
ation screen is displayed on the display 13 (step S212) 
and if a different instruction is detected, flow proceeds 
to the other processing (step S214). At the creation 
screen of step S212, items that must be input to create 
an e-mail, such as the destination, the subject, the mail 
text, and a file attachment and the like. 
[0140] Next, when data is input for selected items or 
a file to be attached is selected, the data for each of the 
input items is stored in an area corresponding to the 
items in the working area 2921 , and the input data (data 
of each item) is displayed on the display 1 3 (step S1 76). 
The image displayed before the send instruction is au- 
tomatically set as one of the file attachments at step 
S216. 

[0141] At this stage, the user can send an image (im- 
age that is displayed at the time of the start) that was 
automatically set as a file attachment at the processing 
of step S216 as a normal file attachment, or can select 
the sending of the image as a file attachment for use as 
the background image for the mail text. In the case in 
which the user sends the image file as a normal file at- 
tachment, the entry instruction is given, and in the case 
in which the image file is to be sent as a file attachment 
for use as a background image for the mail text, a back- 
ground image display instruction is given. 
[0142] Therefore, the controller 22 makes a judgment 
as to whether or not an entry (verification) instruction 
has been given for the input data (step S218). In the 
case in which the entry (verification) instruction is given, 
the mail data currently being worked with is stored into 
the send folder 2922 of the mail data storage area 292 
(step S220), after which a wait is made for either a send 
instruction or an ending instruction (step S222). 
[0143] In the above-described fourth embodiment, 
similar to the case of the third embodiment, in the case 
in which an image is attached to an e-mail, the method 
used is that of attaching the original image itself, and 
also sending information (flag information) that indicates 
that an attached image is to be used as the background 
image for the mail text and brightness correction data 
for display of the attached image as the background im- 
age. 

[0144] In the storage processing at step S220, there- 
fore, of the mail data currently being worked on stored 
in the working area 2921 , data other than the file attach- 
ment address, this being the destination, the subject, the 
mail text, the BDF background image display identifica- 
tion flag, and image brightness correction value, is 
stored in corresponding areas in the send folder 2922. 
The address in the file storage area 293 into which the 
original image is stored is stored in the file attachment 
address storage area of the send folder 2922. 
[0145] At this stage, however, even if there is an im- 
age attached to the mail, the setting of this image as a 
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background image for the mail text has not yet been 
made, the information of BDF background image dis- 
play identification flag of the working area 2921 is infor- 
mation, (the value 0) that indicates that a background 
image display is not to be made, and the image bright- 5 
ness correction value has not been set. Therefore, in- 
formation is set into the BDF background image display 
identification flag (the value 0) indicates that a back- 
ground image display is not to be made, and the image 
brightness correction value remains unset. The MSF 
identification flag of the send folder 2922 is set to the 
unsent condition (0). 

[0146] In the case, however, in which at step S218 
there is no detection of an entry (verification) operation 
in the input data, detection is made of whether or not a 
background image display instruction has been made 
(step S224). In the case in which a background image 
display instruction is not detected, return is made to step 
S216, If a background image display instruction is de- 
tected, however, the image automatically set as the file 
attachment by the processing of step S216 (image dis- 
played the time of the start) is displayed on the display 
13, and the user can adjust the displayed brightness of 
the image (step S226). When the useradjusts the bright- 
ness of the displayed image, the adjustment value (cor- 
rection value with respect to the brightness of the origi- 
nal image) is stored in the correction value storage area 
of the working area 2921 . The display brightness cor- 
rection of the image is continued until the user indicates 
the end of the adjustment, at which point the correction 
value stored in the correction value storage area of the 
working area 2921 is also updated. When the user indi- 
cates the end of adjustments, an overlaid display of the 
mail text with the display brightness corrected image is 
made (preview display) (step S228). 
[0147] If the user views the preview display at step 
S228 and is satisfied with the display, the user makes 
an entry (verification) operation. If the user is not satis- 
fied with the displayed preview, however, the user can 
re-adjust the displayed brightness of the background im- 
age, adjust the mail text, or cancel the background im- 
age display. 

[0148] In the condition with the preview display shown 
on the screen, the controller 22 performs a detection of 
whether or not a re-adjustment instruction is given (step 
S230), a detection of whether or not a text edit instruc- 
tion is given (step S232), a detection of whether or not 
a cancel instruction is given (step S234), and a detection 
of whether or not an entry instruction is given (step 
S236). 

[0149] If at the step S230 a re-adjustment instruction 
is detected, return is made to the display bright adjust- 
ment processing of step S226. If a text edit instruction 
is detected at step S232, the same text editing process- 
ing is performed as at step S80 in Fig. 9 and step S2020 
in Fig. 22 (step S238), after which return is made to the 
preview display of step S228. 

[0150] If a cancel instruction is detected at step S234, 



the correction value stored in the correction value stor- 
age area of the working area 2921 is cleared, and return 
is made to the item data input and display processing of 
step S216. 

[0151] If an entry instruction is detected at step S236, 
the BDF background image display identification flag is 
set to "1" (step S240), after which the storage process- 
ing of step S220 is executed. After the processing of 
step S206, at the storage processing of step S220, be- 
cause the information of the BDF background image 
identification flag in the working area 2921 is information 
indicating the making of a background image display 
(T), of the mail data currently being worked on in the 
working area 2921 , all data with the exception of the at- 
tached file address is stored in the corresponding areas 
of the send folder 2922. Into the file attachment address 
storage area of the send folder 2922 is stored the ad- 
dress in the file attachment storage area 293 in which 
the above-noted original image is stored. 
[0152] If an instruction to send occurs in the waiting 
condition of step S182 or thereafter in the condition in 
which mail data is read out from the send folder 2922, 
the mail data (subject and mail text) stored in the send 
folder 2922 is sent to the specified destination, along 
with the image brightness correction value and the BDF 
background image display identification flag. When this 
is done, the time sent is stored into the date and time 
sent storage area of the send folder 2922, and the SDF 
identification flag is set to "1" to indicate the sent condi- 
tion. 

[0153] As noted above, in the fourth embodiment of 
the present invention, if a send instruction is given in the 
condition in which an image is displayed, the new mail 
creation mode is selected, and with the exception of the 
fact that the image that had been displayed being auto- 
matically set as the file attachment, the fourth embodi- 
ment is the same as the third embodiment. Therefore, 
although the partial variations in the mail creation 
processing and received mail display processing were 
described above, items that were described above with 
regard to the third embodiment have not been repeated 
where they are the same as in the fourth embodiment. 
[0154] It will be understood that the foregoing embod- 
iments are presented as exemplary, and do not restrict 
the present invention, which can be embodied in other 
forms and manners that are encompassed by the spirit 
of the present invention as recited in the attached 
claims. 



1 . A data communication apparatus comprising: 

means (149, steps S22, S176 and S216) for 
preparing a document to be sent; 
means (145, step S36) for preparing an image 
to be sent; 
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means (steps S16, S202 and S236) for setting 
whether or not the image is to be displayed as 
a background image for the document on the 
display of a receiving-side communication ap- 
paratus receiving the document; and 
means (11, 20, 21) for sending, as one set of 
data, the document, the image and information 
capable of distinguishing that the image is to be 
displayed as a background image for the doc- 
ument in a case in which the setting means sets 
display as a background image. 

2. The data communication apparatus according to 
claim 1, comprising means (13, steps S54, S138, 
S194 and S228) for displaying the document with 
the image as a background image before sending 
the data. 

3. The data communication apparatus according to 
claim 1, comprising means (steps S46-S50 and 
S64, steps S122-S134 and S148, step S192, step 
S226) for processing the image so that both the 
document and the image are visually verifiable 
when the image is displayed as a background im- 
age for the document. 

4. The data communication apparatus according to 
claim 3, wherein the processing means is a means 
(steps S46-S50 and S64) for correcting a bright- 
ness of the image, and 

wherein the sending means sends a bright- 
ness-corrected image. 

5. The data communication apparatus according to 
claim 3, wherein the processing means is a means 
(steps S192 and S226) for correcting a brightness 
of the image, 

wherein the sending means sends an image 
and brightness correction data. 

6. The data communication apparatus according to 
claim 3, wherein the processing means is a means 
(steps S122-S134 and S148) for selecting and 
overlaying the image with templates having differ- 
ent brightness filter functions, and 

wherein the sending means sends an image 
and data specifying a template. 

7. The data communication apparatus according to 
claim 6, wherein the processing means comprises 
a means (steps S120-S134) that distinguishes a 
brightness of the image and selects a template hav- 
ing a filtering function responsive to the brightness. 

8. The data communication apparatus according to 
claim 1, comprising means (step S52) for changing 
a color of characters of the document, based on a 
brightness of the image. 



9. The data communication apparatus according to 
claim 1, further comprising means (181) for photo- 
graphing an object, and wherein the image compris- 
es an object image photographed by the photo- 

5 graphing means. 

10. The data communication apparatus according to 
claim 1, comprising: 

10 means (1 1 , 20, 21 ) for receiving data; 

display control means (step S100) for display- 
ing the image as a background image for the 
document in a case in which data received by 
the receiving means includes a document, an 
15 image and information that can distinguish that 

an instruction is given to display the image as 
a background image for the document. 

1 1 . A data communication apparatus capable of receiv- 
20 ing data sent by another data communication appa- 
ratus, comprising: 

means (11, 20, 21) for receiving data; 
display control means (step S100) for display- 
25 ing the image as a background image for the 

document in a case in which data received by 
the receiving means includes a document, an 
image and information that can distinguish that 
an instruction is given to display the image as 
30 a background image for the document. 

12. The data communication apparatus according to 
claim 11, wherein 

the information that can distinguish is informa- 
35 tion indicating an instruction to display the image as 
a background image for the document and/or 
brightness-correction data of the image, and where- 
in 

the display control means, in a case in which 
40 data received by the receiving means include 
brightness-correction data, corrects the brightness 
of the background image based on the brightness- 
correction data. 

45 13. The data communication apparatus according to 
claim 11, wherein 

the information that can distinguish is informa- 
tion indicating an instruction to display the image as 
a background image for the document and/or data 

50 specifying a template, the data communication ap- 
paratus comprises templates having different 
brightness filer functions, and 

wherein the display control means selects 
and overlays the image with one of templates based 

55 on specification data, in a case in which the data 
received by the receiving means includes template 
specification data. 
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14. The data communication apparatus according to 
claim 11, further comprising: 

a display switching means (143, step S106) for 
switching from a condition in which the image 
is displayed as a background image for the doc- 
ument to a display of either the image only or 
the document only. 

1 5. A data communication system comprising a first da- 
ta communication apparatus (1a) and a second da- 
ta communication apparatus (1b), and capable of 
data communication from the first data communica- 
tion apparatus to the second data communication 
apparatus, wherein 

the first data communication apparatus com- 
prises: 

means (149, steps S22, S176 and S216) for 
preparing a document to be sent; 
means (145, step S36) for preparing an image 
to be sent; 

means (steps S16, S202 and S236) for setting 
whether or not the image is to be displayed as 
a background image for the document on the 
display of a receiving-side communication ap- 
paratus receiving the document; and 
means (11, 20, 21) for sending, as one set of 
data, the document, the image and information 
capable of distinguishing that the image is to be 
displayed as a background image in a case in 
which the setting means sets display as a back- 
ground image, and wherein 
the second data communication apparatus 
comprises: 

means (11, 20, 21) for receiving data; 
display control means (step S100) for dis- 
playing the image as a background image 
for the document in a case in which data 
received by the receiving means includes 
a document, an image and information that 
can distinguish that an instruction is given 
to display the image as a background im- 
age for the document. 

16. A data communication method whereby a docu- 
ment and an image are sent from a first data com- 
munication apparatus to a second communication 
apparatus and the image is displayed on a display 
of the second data communication apparatus as a 
background image for the document, comprising: 

a step (steps S22, S36, S176 and S216) in the 
first data communication apparatus of prepar- 
ing a document to be sent and an image to be 
used as a background image for the document; 
a step (steps S60, S144, S1 82 and S222) in the 



first data communication apparatus of sending 
the document, the image and information that 
indicates the display of the image as a back- 
ground image for the document; 
5 a step in the second data communication ap- 

paratus of receiving data sent from the first data 
communication apparatus; and 
a step (step S100) in the second data commu- 
nication apparatus of displaying the image as 
to the background image for the document in a 

case in which the received data included the 
document, the image and the indicating infor- 
mation. 

15 17. A data communication method according to claim 
16, further comprising: 

a step (one of steps S54, S138, S1 94 or S228) 
of displaying the image as a background image 
20 before sending the data. 

18. A data communication method according to claim 
16, further comprising: 

a step (steps S46-S50 and S64, steps 
S122-S134 and S148, step S192 or step 
S226) of processing the image so that both the 
document and the image are visually verifiable 
when the image is displayed as a background 
image for the document. 

19. A data communication method according to claim 
18, wherein 

the image processing step is a step (step S64) 
of correcting a brightness of the image, and 

wherein the data sending step sends bright- 
ness-correction data along with the image. 

20. A data communication method according to claim 
18, wherein 

the image processing step is a step (steps 
S122~ S134) of selecting and overlaying theimage 
with templates having different brightness filter 
functions and 

wherein the data sending step sends an im- 
age and data specifying a template. 
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